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Abstract. We examine a version of the Cops and Robber (CR) game in which the robber is 
invisible, i.e., the cops do not know his location until they capture him. Apparently this game 
(CiR) has received little attention in the CR literature. We examine two variants: in the first the 
robber is adversarial (he actively tries to avoid capture) ; in the second he is drunk (he performs 
a random walk). Our goal in this paper is to study the invisible Cost of Drunkenness (iCOD), 
which is defined as the ratio cti(G) / dct^G) , with ctj(G) and dcij(G) being the expected capture 
times in the adversarial and drunk CiR variants, respectively. We show that these capture 
times are well defined, using game theory for the adversarial case and partially observable 
Markov decision processes (POMDP) for the drunk case. We give exact asymptotic values of 
iCOD for several special graph families such as d-regular trees, give some bounds for grids, and 
provide general upper and lower bounds for general classes of graphs. We also give an infinite 
family of graphs showing that iCOD can be arbitrarily close to any value in [2, oo). Finally, 
we briefly examine one more CiR variant, in which the robber is invisible and "infinitely fast"; 
we argue that this variant is significantly different from the Graph Search game, despite several 
similarities between the two games. 



1. Introduction 

Cops and Robber (CR) is a game introduced by Nowakowski and Winkler [38] and (indepen- 
dently) by Quilliot [44] . CR is played on a fixed, undirected, simple and finite graph G where 
K cops pursue a single robber. Both the cops and the robber are located in the vertices of G 
and everybody has full information about everybody else's current location. In every turn of 
the game, first the cops and then the robber can move to their new locations along the edges 
of the G. The cops win if they capture the robber, i.e., if at least one cop is in the same vertex 
as the robber; the robber's goal is to avoid capture. This is the "classical", extensively studied 
version of the CR game. Many other versions have been proposed and studied; for a review of 
the literature see [21 El [19] and the book [5]. 

We call the robber of the classical CR game adversarial: he wants to avoid capture for as long 
as possible and plays optimally towards this end. In a recent paper [26J we have studied a CR 
variant where the robber is drunk, i.e., he performs a random walk on G (he does not attempt 
to avoid capture; essentially he is oblivious of the cops). This is really a one-player game. In 
[25] we have compared the adversarial and drunk CR variants and have especially studied the 
Cost of Drunkenness (COD), i.e., the ratio of "adversarial" capture time and "drunk" expected 
capture times. 

In the current paper we are concerned with the much less studied version of the CR game, in 
which the robber is invisible to the cops (unless they are located in the same vertex). All the 
other rules remain the same as in the classical CR and we examine both the adversarial and the 
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drunk variants. We will call this game cops-and-mwsz&ie-robber (CiR). Our main goal is (as in 
OT to study the "invisible COD" (iCOD). 

CiR and, more generally, invisible robber versions of CR have so far received little attention 
in the graph theory literature. To the best of our knowledge, the first paper that deals with 
the invisible robber is [52j. More recent work in which the cops have either zero, incomplete 
or intermittent information about the robber's location include [12j [T3J, |25l [51]. In addition, 
some works [TTI [131 [T5J [16] examine the case in which the cops' incomplete observations are 
augmented by the use of traps, alarms, radars and so on. The variant of an intermittently 
observed robber is related to another variant, where the robber moves with greater speed than 
the cops; this is studied in [TJ. All these works share a common approach, according to which 
cops use a predetermined move sequence by which capture is guaranteed. Because the cops will 
only see the robber when they capture him, this sequence does not depend on actual robber 
moves, hence it can be computed before the CiR game starts. Furthermore, the robber can also 
compute the same sequence, so he is omniscient in the sense that he knows all cop moves before 
the game starts. This approach is also used in graph search (GS) games in which the robber 
is also endowed with infinite speed. However, we will argue in Section [7j that GS is a different 
game from CiR (the seminal paper for graph search is [32]; good recent reviews are [21 El US])- 

In this paper we are interested in a different approach, which improves the cops' fortunes. 
Since the cops will never see the robber, they must predetermine their strategy; but this can be 
randomized, so the actual cop moves do not need to be predetermined at the beginning of the 
game. Hence, in CiR, at every time step the robber will know previous cop moves but not the 
future ones. As we will show in later sections, the use of randomized strategies can, in some 
cases, reduce the number of cops necessary to capture the robber, provided that our goal is to 
obtain a finite expected capture time and so cops win the game after a finite number of steps 
with probability one. 

Randomized strategies have not received much attention in the graph theoretic CR literature. 
From the few papers which explore this approach, we mention [Tj [231 123] (note that in pQ both 
cops and robber are invisible to each other until they occupy the same vertex). Brief mentions 
of randomized strategies also appear in [HI [51] . 

On the other hand, there is a large robotics literature which deals with the (more general) 
pursuit/evasion problem; while roboticists do not often use the term "cops and robber", they 
have studied pursuit / evasion on graphs using formulations quite similar to CiR, especially for the 
case of the drunk robber; see for example El |2B [221 123 1221 EH [531 M\ and the review [ID] . As 
expected, this research is more application-oriented. Also, the operations research community 
has studied what is essentially the search for an invisible drunk robber in a graph; we only cite 
here three representative works here [23 SSI ED] ■ 

Most of the works cited in the previous paragraph handle the invisible drunk robber with tools 
from the theory of partially observable Markov decision processes (POMDP; see [3T1I351 H8]) and 
this is the approach we will use in the current paper. For the invisible adversarial robber, we 
believe the "natural" treatment is through game theoretic methods; in fact what is required is 
the generalization of POMDP's to stochastic or Markovian games. The subject was introduced 
in [36] ; some of the subsequent results can be found in0[T7J[THll27J[3S[311l3SlE7JSQll3Ili51l53; 
a paper we have found especially useful is |20j. 

The rest of the paper is organized as follows. In Section [2] we introduce preliminary notation 
and results. In Section [3] we give an extended example which illustrates the basic aspects of the 
CiR game and, perhaps more importantly, establishes that the iCOD can become arbitrarily 



COPS AND INVISIBLE ROBBERS: THE COST OF DRUNKENNESS 



3 



large. In Section[4]we prove that the value of the CiR game always exists (for both the adversarial 
and drunk variant). In Section [5] we provide general upper and lower bounds, which are then 
used and tightened in Section [6] to obtain (almost) exact values for special graph classes, among 
them <i-regular trees and grids; we also introduce the family of broom graphs and use it to show 
that the iCOD can be arbitrarily close to any value in [2, oo). In Section [7] we briefly study CiR 
(and compare it to GS) when the robber has "infinite" speed. In Section [8] we summarize and 
discuss our conclusions. 



2. Preliminaries 

Let G = (V, E) be a fixed undirected, simple, connected and finite graph. We begin by listing 
definitions, notation, assumptions and a useful theorem. 

(1) N = {1,2,3,...} and N = {0, 1, 2, . . .}. 

(2) We will always use n to denote the number of vertices of G (i.e., | V^(C) | = n). 

(3) We assume that the cops-and-robber game (both the CR and CiR versions) are played 
by two players, denoted by C (the cop player) and R (the robber player). 

(4) C controls K cops (K G N, we will denote {1, 2, ... , K} by [K]). G V denotes the 
position of the fc-th cop at time t (k G [K], t G N ); X t = {X}, X?, . . . , Xf ) G V K 
denotes the vector of all cop positions at time t. 

(5) R controls a single robber, whose position at time t G N is denoted by Y t G V . 

(6) Actually R is active only in the adversarial variants. In the drunk variants the robber 
performs random walk on G (we could say he is controlled by Chance) according to the 
following rules 

Vue V,Pr(Y„ = ti) = ji, (1) 

v„ e ,,Pr(y w = ^, = ») = {« < 2 > 

{N{y) is the neighbourhood of vertex v; N(v) does not include v). 

(7) The moving sequence in the adversarial variants is as follows. At t = 0, first C chooses 
initial positions Xo G V , then R chooses Yq G V. For t G N first C chooses X t G V K 
and then R chooses Y t G V. Movements are possible only along edges of G; that is, 
{Xf, Xf +1 } G E and {Y t , Y t+1 } G E, for all k G [K] and t G N . 

(8) The moving sequence in the drunk variants is the same, except that Yq, Y±, Y%, . . . are 
chosen by Chance, according to equations Q-(|2]). 

(9) The capture time is denoted by T and defined as follows 

T = min{t : 3k G [K] such that X k t = Y t }; 

that is, T is the first time a cop is located at the same vertex as the robber (note that 
this can happen during either a cop move or a robber move). If capture never takes 
place, then T = oo. As will be seen in the sequel, capture time will in general be a 
random variable, dependent on the strategies used by the cop and the robber (and also 
on K). 

In what follows, unless stated otherwise, it will be assumed that (a) C's goal is to capture the 
robber as fast as possible and (b) he plays optimally with respect to this goal; we will summarize 
these assumptions by saying that C is adversarial. R can be in one of two modes: adversarial 
(he plays optimally to avoid capture for as long as possible) or drunk (he simply performs a 
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random walk on G). The cops' locations are always known to the adversarial R (specifically, at 
time t he knows Xq, Xi, . . . , X t ). The robber can be visible (his location is known to the cops) 
or invisible (his location is unknown). 

When the robber is visible and adversarial, T is deterministic [26]. The cop number of G 
is denoted by c(G) and defined to be the minimum K for which T < oo (there is always such 
a K, less than or equal to |V|). We define ct(G) to be the "optimal capture time given that 
K = c(G) and C and R play optimally" (this definition requires some care, see |26j). When the 
robber is visible and drunk, he performs a random walk on G as indicated by pp-pj). In [26] we 
show that the following quantity is well defined 

dot (G) = E (T | when K = c (G) , C plays optimally, R is drunk) . 

Hence the cost of (visible) drunkenness is also well defined by 

F(G) - Ct{G) 

F[G) - dewy 

and we obviously have F(G) > 1 (capturing the adversarial robber is at least as hard as capturing 
the drunk one, since the former can always choose to behave as if he were drunk). 
Let us now turn to the invisible robber. In [26] we have proved the following. 

Theorem 2.1. Suppose that c(G) cops perform a random walk on a connected graph G, starting 
from any initial position and the robber is adversarial. Then E (T) < oo. 

It follows that c(G) adversarial cops suffice to capture the invisible adversarial robber. On 
the other hand, capturing the invisible robber is at least as hard as capturing the visible one, 
hence c(G) is also the minimum required number of cops. In short, the cop number of a graph 
is the same for the visible and invisible CR version (however, the expected capture time T will 
generally be bigger in the invisible variant, comparing to the capture time in the visible one). 
In the rest of the paper we will always assume that the number of cops is K = c(G). 

For the invisible variant of the game we will define 

cti (G) — E(T \ K — c (G) , C and R play optimally) , (3) 
dcti (G) — E (T | K — c (G) , C plays optimally, R is drunk) , (4) 

Fi(G) is the "invisible cost of drunkenness "(iCOD). Note that we will always assume that 
n > 2 and so cti(G) > dcti(G) > 0. The existence of the quantities defined in ([3])-((5| and the 
meaning of "optimal play" require careful study, which will be deferred to Section |4j we will 
first present an extended example in Section [3] 

3. The Invisible Cost of Drunkenness Can be Arbitrarily Large 

To clarify some of the key CiR concepts, we now present an extended example which involves 
the iV-star graphs Sn, illustrated in Figure [I] and defined as follows (note that, for all N, we 
have n = \V\ = N + 1). For iV e N, S N has vertex set V = {0,1,..., N} and edge set 
E = {(0, 1), (0, 2), ... , (0, N)}. Obviously a single cop can catch the visible robber in Sn- So 
we will study CiR with a single cop, as well. 

A robber strategy generates a robber's move for every time t, based on the information avail- 
able to R at time t; this information is the cop moves Xq,Xi,. . . ,X t and the robber moves 
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Figure 1. The iV-star S N . 

Yq, Yi, . . . , Y t -\. As will become clear, R may gain an advantage by randomizing his strategies. 
Hence a robber strategy o~r is an infinite sequence of probability distributions conditioned under 
previous moves/positions of both cops and robber: 

o R = {Pr (Y t | X = x ,...,X t = x t ,Y = y ,..., Y t -i = J/t-i)}* ■ ( 6 ) 

The strategies must also be feasible, i.e., only moves along edges can have positive probabilities. 
Similarly a cop strategy o~c is an infinite sequence of probability distributions conditioned under 
previous moves/positions of only the cops (and an initial probability, for t = 0): 

a c = {Pr (X t \X = x ,..., X t _t = x^)}^ U {Pr (X )} . (7) 

The conditionals must satisfy the feasibility requirement. Note that conditioning is on cop 
moves only, since the robber is invisible to the cops. However, let us stress that the sequence of 
previous moves of the cops affects their strategy for the future, since the fact that the robber 
was not seen at these vertices before contains important information. In the adversarial variant, 
the expected capture time depends on both or and ac, hence we will write E (T \ a R , ac)- In 
the drunk variant we will write E (T | ac) instead. 

Now let us consider optimal cop and robber strategies for Sn- We will first deal with the 
adversarial variant. Let us fix some N > 2 (so Sn is a tree with N leaves) and let C use the 
following strategy: he chooses a permutation u\u 2 ... mat of the set [N] with uniform probability 
(Pr (uiU 2 ... m^) = Ty,) and the cop moves as follows 

X = ui,Xi = 0, X 2 = u 2 , X 3 = 0, X 4 = u 3 , . . . , X 2 n-2 = u N . 

In other words, the cop starts at a random leaf and visits every other leaf in a random order 
(without repetitions). Therefore there exists a cop strategy ac of the form ^ which produces 
this sequence. 

Now, R sees X Q = u\ before placing the robber and he knows that the cop has no incentive to 
stay in place, so he infers that X\ = 0. Hence R knows that Y must belong to {u 2 , u 3 , . . . , un} 
but he has no incentive to prefer one of these (since he is unaware of the order by which they will 
be visited by the cop), and thus he will place the robber equiprobably in one of {u 2 , u 3 , . . . , u^}. 
After the initial placement, R will never move the robber because the only possible move is 
into and this would result in a capture (either the robber runs into the cop during an odd 
turn, or vice versa during an even turn). Hence the robber will use the strategy or which sets 
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Y — v G {u2,u 3 , . . . ,un} with probability wzr, and Y t = Y for t = N. For every initial cop 
placement we can compute 

E(T I a R ,a c ,X = u l ) = — — 2+ — — 4+...+—^ — (2JV-2) = — — ^— - ^ ' - = A" 

and, since there are A" equiprobable choices for U\, we also have 

E (T | d R ,a c ) = N. 

As we have already argued, d R gives to R the best possible result (longest expected capture 
time) given C uses dc- In other words, 

max E (T \ a R , d c ) = E (T \ d R , d c ) = N 

from which follows 

min max E (T | a R , a c ) < E (T \ a R , a c ) = N. (8) 

CC PR 

By the same argument, if the cop decided to start at the root and visit the leaves in a randomly 
chosen order, the expected capture time of the best robber (choosing uniformly at random any 
leaf) would also be N. On the other hand, suppose R uses a R irrespective of C's strategy 
Clearly C must use a strategy which visits every vertex and, since he has no reason to prefer 
a particular order of visitation, he will do just as well by using dc (he gains no advantage by 
visiting the same vertex twice). Hence we have 

N = E (T \ a R , d c ) = min E (T | a R , a c ) =>- 

N = E (T | a R , ac) < max min E (T \ a R , ac) ■ (9) 

&R 



Finally, we know that 



max min E (T | a R ,ac) < min max E (T | a R ,ac)- (10) 

0"H 0"C °"C a R 



From rt8h- ( 10 ) we see that 



max min E (T \ a R , ac) = E (T\a R , ac) = min max E (T \ a R , ac) = N. 



In other words, a R and ac are optimal strategies for R and C, respectively, and the optimal 
expected capture time in the adversarial variant is 

cU(S N ) = N = n-l, (11) 



for all > 2; it is easy to see that (11 ) also holds for AT = 1. 

Let us now turn to the drunk variant. In this case only C has to choose a strategy and the 
optimal dc is obvious: he places the cop at u = and just waits there. For any N > 1, the 
robber will start at with probability or at some u G {1,2,..., A^} with probability 
In the former case T = 0; in the latter case the robber will move into at t — 1, resulting at 
T — 1. Hence 

A^ n — 1 

dcU (S N ) = E(T | d c ) = = — • (12) 



From (11) and (12) we get F{ (Sn) = N + 1 = n. It follows that the cost of drunkenness F^Sn) 
can attain any integer in N. Our results are summarized in the following. 
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Theorem 3.1. For every N > 1 we have 

N n — 1 

cti{S N ) = N = n - 1, dcti{S N ) = — — = , Ft (S N ) = N + 1 = n. 

JM + 1 n 

4. The Cost of Drunkenness is Well Defined 

In the previous section we have proved that Fi (G) can take arbitrarily large values. Our proof 
involved only a particular family of graphs, the iV-stars. In this section we will show that iCOD 
is well defined for every graph G. The real issue, of course, is whether cti(G) and dcti(G) are 
well defined. Settling this question requires the use of game theoretic concepts for cti(G) and 
POMDP concepts for dcti(G). For simplicity, we will consider the case of a single cop (K = 1); 
the generalization to K > 1 is straightforward. Hence we pick a graph G with c (G) = 1 and 



keep it fixed for the rest of the section (but Lemma 4.1 and Theorems 4.2 and 4.4 remain true 
for any G). 

4.1. Adversarial Robber. Here we show that cti(G) is well-defined. Our notation and analysis 
follows very closely [20J. The adversarial variant of CiR is a two player game, which we will call 
T, played on G. Note that F can last an infinite number of turns (the robber is never captured). 
We will also make use of auxiliary, truncated games: T m is the same game as T but is played 
for a maximum of m turns. 

C moves the cop according to a strategy ac- For a rigorous definition of strategy we need the 
following. 

(1) A c = V is the set of possible C actions (possible placement of the cop on G). 

(2) Hq C V m is the set of feasible m long sequences of cop configurations. 

(3) Ho = Um=o-^cT' ) ^ s ^ ne se t of all finite-length feasible cop histories. 

(4) P (Ac) is the set of all probability functions on C actions. 

Hence a cop strategy is a function a c : H c — > P (A c ), i.e., a function which maps to every 
finite-length history xq,xx, . . . , x t -\ a probability (conditional on xq, x%, . . . , x t -\ when t > 0) 
on the next C move X t . We are interested in feasible strategies, i.e., those which assign positive 
probabilities only to feasible next-step cop configurations; we will denote the set of all feasible 
C strategies by Sc- 

The situation is almost identical for R. A strategy or specifies the next robber move at time 
t, depending on information available to R at £; this information is the realizations Xq, xi, . . . , x t 
and y ,yi, . . . , yt-i- We define the following. 

(1) A R — V is the set of possible R actions (possible robber positions). 

(2) H { ™ } CV m x V m ~ x is the set of feasible m long sequences of cop/robber configurations. 

(3) H R = Um=o^lr' i s t ne set of all finite-length feasible cop/robber histories. 

Hence a robber strategy is a function o~r : Hr — > P (Ar), i.e., a function which maps to every 
finite-length history a probability on the next R move; again, we are interested in feasible strate- 
gies, i.e., those which assign positive probabilities only to feasible next-step cop configurations. 
We will denote the set of all feasible R strategies by Sr. 

A specific strategy pair (a R , ac), specifies the probabilities p (x , x%, . . . , x t , yo, Vi, ■ ■ ■ Vt I °~Ri °~c) 
for all cylindrical sets (Xq = xq, Xi — x\, . . . , X t — x t , Y — y , Y\ — yi, . . . ,Y t — y t ). Hence, let- 
ting Hr = V NxN denote the set of all infinitely long feasible cop/robber histories, (aR, ac) 
induces a probability measure on the associated a- algebra. In short, at the start of the game T, 
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C chooses o"c and R chooses <7r, resulting in a well defined expected capture time, conditioned 
on a R and ac] this quantity is denoted by E (T | cr R , a c , T)- 

The strategies o~r and o~c can be used in any truncated game T m as well: C and R will use 
them to generate moves only until turn m. Hence the corresponding expected capture time for 
T m is also well defined; it will be denoted by E (T \ or, <7c, T m ). Clearly T and every T m are 
two-person, zero-sum games. 

It is worth emphasizing that C and R choose their strategies simultaneously, before the game 
starts. Even though the game rules stipulate that (in every turn) C plays before R, this is 
unimportant because (the probabilities of) both players' moves are specified by their strategies, 
which have been selected before the game starts. (It is a well known fact jl] that, if either player 
chooses his optimal strategy then he has no incentive to change it, no matter what strategy the 
other player uses.) In fact, the rules can be modified so that the players play simultaneously: at 
the initial turn (t — 0) R plays a "null" move and C plays Xq\ at all subsequent turns (i G N), 
R plays Y t -\ and C plays X t . The game remains the same under these modified rules. 

In T, if R uses or and C uses o~c then C pays R E (T | or, oq-, T) per game (on the average). 
The situation is similar in T m (for every m e No) except that the game lasts at most m steps 
and if the robber has not been caught by the end of the m-th step, he receives a payoff of m; 
the average payoff in T m is E (T | a R ,ac,T m ). In either case (full or truncated game) R tries 
to maximize the payoff while C tries to minimize it. 

Consider for a moment pure strategies available to C in the finite-length game T m . Each 
such strategy, call it sc, will be a collection of deterministic functions mapping finite length cop 
histories xq, xi, . . . , x t -\ to feasible moves: 

X t = / {xo,xx, . ..X t -l) . 

Since t < m and \V\ is finite, there is a finite number of cop histories and a finite number of 
pure strategies that C can use. Similarly R has a finite number of pure strategies. Hence T m is 
a finite game and has a value [4], which however is generally achieved by mixed strategies a R 
and 

™i n c E {T 1 ^ Tm) =E ( T 1 ^ Fm ) = E {T 1 **' ^ Tm) 

(13) 

(In fact T m can be summarized by a finite payoff matrix where Q^™; so = E (T I S R> s Ci r m ) 
and sr, sc are understood as classes of pure strategies which are identical up to the m-th turn.) 

We sometimes will denote E (t \ 0^,0^, T m j by val (T m ), for brevity. 

In the infinite-length game T there is an infinite number of pure strategies, hence the existence 
of a value and optimizing strategies is not guaranteed. Let us define 

val (r) = sup inf E (T \ a R ,ac,T) 

val (r) = inf sup E (T \ aR,ac,T). 

°c£S c aR es R 

Hence R, playing optimally, is guaranteed to receive no less than (arbitrarily close to) val (r); 
C, playing optimally, is guaranteed to pay no more than (arbitrarily close to) val (T); we have 
val (r) < val(T). What we want is to show val (T) = val(T); if equality holds, then we will 
denote the common value by val (T), the value of the game T. 
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Existence of val (T) follows almost immediately from a theorem proved by Gurevich [20]. A 
couple of modifications of his proof are required. First, we need the following lemma. 

Lemma 4.1. Given any graph G, let a~c be the strategy according to which the cop performs a 
random walk on G. Define v = sup g5 E (T | a R ,a~c, T). Then 

lim val (r m ) < vol (T) <v<oo. 



Proof. From Theorem |2.1| we know that, when the cop random-walks in G, he can catch the 
robber in finite expected time. Hence 



sup E (T | a R , a c , T) = v < oo. (14) 



Then we have 



val (r) = sup inf E (T \ a R , ac, T) < sup E (T \ a R , a c , T) = v < oo. 

If we extend the truncated game T m by one move we get the game r m+1 and R's payoff cannot 
decrease. Hence val (T m ) < val (r m+1 ), i.e. the sequence {val (r m )}^ =0 is nondecreasing. It is 
also bounded, because in the full game T, R can do at least as well as in any truncated game T m . 
Hence val (T m ) < val (r m+ i) < val (T), from which follows v = lmim^oo val (T m ) < val (V). □ 



Using Lemma 4.1 we can now prove the following. 

Theorem 4.2. Given any graph G and the corresponding CiR game V played with c (G) cops, 
val (r) exists and satisfies 

val (r) = lim val (T m ) . 
Furthermore, there exists a strategy a~c such that 

sup E (T | crR,cxc,r) = val (T) (15) 

and, for every e > there exists an m e and a strategy a £ R such that 

Vm > m £ : val (T) — e < inf E (T | a £ R , ac, T m ) . (16) 

Proof. The theorem is a rephrasing of Gurevich's Theorem 1 |20j and his proof can also be used 
here, except for the following two points. 

(1) Gurevich assumes E (T | a R , ac,T) is bounded: 

3M :V(a R ,a c ) : \E (T \ a R ,a c ,T)\ < M 

This is not necessarily true for CiR. But, as he points out [201 P-372], this assumption 
can be removed, provided the sequence {val (r m )}^ =0 is bounded; in the CiR game this 
is true because of Theorem 2.1 (as discussed in the proof of Lemma 4.1). 

(2) Gurevich studies games in which the two players move simultaneously. In CiR this is 
not the case but, since C never sees R's move, we can (as already mentioned) rearrange 
the order of moves and have the moves (Y t -i,X t ) take place simultaneously. 

Other than these two points, Gurevich's proof applies exactly to the current theorem. □ 



Remark. From (15) we see that C has an optimal strategy. From (16) we see that, for every 
e > 0, R has an "e-optimal" strategy, which is uniformly good (i.e., for all m > m e ). 
We now can replace equation pi) with a rigorous definition of cU (G). 
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Definition 4.3. Given a graph G, we define the invisible capture time of G to be 

ctt (G) = vol (r) 
where the game T is played on G with c (G) cops. 

Hence cti (G) is not necessarily an achieved expected capture time, but it can be approximated 
within any e > by using strategies o\ and ac- 

4.2. Drunk Robber. We now turn to the drunk variant of CiR. Our goal is to rigorously define 
dcti (G). Since a single player is involved, the situation is simpler than in the adversarial variant. 
In fact, as we will now explain, the drunk variant of CiR is a partially observed Markov decision 
process (POMDP) [HI 133 EE!- 

The robber process Y t is a Markov chain on V, with transition probability matrix P. As 
explained in [25], the joint process (X t , Y t ) is also a Markov process on the extended state space 
(V x V) U {A}, where A is the capture state. (X t ,Y t ) is governed by the controlled transition 
probability matrix P (Ut), where Ut = X t is the control variable (selected by C) which changes 
the transition probabilities [26]. In particular, P (Ut) assigns probability 1 to transitions from 
"diagonal" states (X t ,X t ) to the capture state A. C's goal is to select the sequence Uq, U±, . . . 
so as to minimize expected capture time. The state (Xt, Yt) is partially observable by C, since 
he never knows Y t . 



We will use the notation of Section 4.1 denoting, however, the full one-player game by T and 
the truncated one-player game by T m . We also need the following facts. 

(1) Sc, the space of cop strategies, is compact. This is so by Tychonoff 's theorem, since Sc 
is a product of probability spaces and the probabilities are on finite event sets. 

(2) For every m G N , E (T \ ac, T m ) is a continuous function of a c (with domain Sq). This 
is the case because E (T \ o~c, r m J depends continuously on a finite number of variables. 

C must select a strategy ac which minimizes 

too 
J2^(Xt^Y t ) | a c ,T 
t=o 

here 1 (X t ^ Y t ) is the indicator function of the event X t ^ Y t ; this is a typical infinite horizon, 
undiscounted POMDP problem. Such problems have been studied by several authors [431 HZ] 
who prove the existence of a minimizing strategy for a quite general setup using rather involved 
proofs. We present a simpler and shorter proof, based on the reduction of Gurevich's argu- 
ment [20] to the one-player case. The proof is useful to illustrate the issues involved, and may 
also have some independent interest. 

Note that, similarly to the adversarial variant, Pr (T \ ac, r m ) is well defined (for every ac) 
and can be extended to Pr (T \ ac, T) • Hence E (T \ ac, T m ) , E (T \ ac, T) are well defined for 
every ac € Sc- Let us define 

val (r m ) = inf E (T \ a c , T m ) , 
val (f 7 ) = inf E (T | a c , F) . 

We then have the following. 

Theorem 4.4. Given any graph G and the corresponding CiR game T, we have 

val (r) = lim val (T m ) . 
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Furthermore, there exists a strategy ac such that 

E (T | a c , T) = val (f) . 

Proof. We have 

inf E (T | a c ,T m ) < inf E (T | a c ,T m+ i) < inf E (T | a c ,T) . 

crc&Sc crc&Sc ac^Sc 

Hence 

val (r m ) < val (r m+1 ) < val (T) < E (T \ a c , r) < oo, 

where ac is the random-walking strategy, which is guaranteed to capture the robber in finite 
expected time. Hence v = lmim^oo val (r m ) exists and v < val (V) . 

Now, in val (r m ) = inf^ E (T \ ac, T m ) , the infimum is achieved by some a™ (since 
E (T I ac, T m ) is a continuous function of the ac probabilities, which take values in a com- 
pact set). Define 

K m = {a c : E (T | a c , T m ) < v] . 
Since E (t \ a^^T^ < v, every K m is nonempty. Also, val (T m ) < val (r m+ i) < v implies 

that K m+ i C K m . As mentioned, E (T \ ac,T m ) is a continuous function on Sc and Sc is 
compact. For every m, K m is the preimage of the compact set [0, v), hence K m is compact. It 
follows that 

oo 

K OQ = f]K m 

m=0 

is nonempty. So let us take some ac £ -^Cx.- Then 



E(T\a c ,T) = lim Vt-Pr (T = t I ? c ,r) 

t=0 
in 

lim t ■ Pi (T = t \ a c , T m ) = lim E (T \ a c , T m ) < v. 

m — i(Yi < • m. — i(Yi 



m— ¥00 ■ 

t=0 



In other words, we have val (r) < v. Hence val (T) = v and is achieved by ac ■ D 

We now provide a formal definition of dcti (G) (to replace equation Q). 
Definition 4.5. Given a graph G, we define the invisible drunk capture time of G to be 

dcti (G) = val (r) 

where the game T is played on G. 



4.3. Discussion. The results of Section |4.2| show that for every graph G there is an optimal 
average capture time dcti{G) and the cop player can catch the drunk robber in dcti{G) turns 
of the game (on the average) if he plays the optimal strategy ac- The actual computation 
of dcti(G) and ac is the subject of ongoing research in the POMDP community. While the 
problem is well understood in principle (an optimality equation must be solved, similar to the 
one presented in [20] for the CR problem) and despite much effort, currently available POMDP 
algorithms are not computationally viable, even for moderate-size graphs (the interested reader 
is referred to (32l [35] for an extensive discussion of the issues involved). 



The results of Section 4.1 yield similar conclusions for the adversarial robber, with one differ- 



ence. Namely, while an optimal strategy ac is available to C, the best R can do is to approximate 
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cti(G) within e (for any e > 0) by using an e-optimal strategy a R . In the computational direc- 
tion, even less progress has been achieved than in the drunk robber case (see [IS])- 

We consider the development of efficient CiR algorithms important, especially from the ap- 
plications point of view. Further, since exact algorithms quickly become intractable (even for 
relatively small graphs), we believe that the solution will be obtained by algorithms which are 
approximate but have performance guarantees. Such algorithms will probably make use of 
domain-specific heuristics. 

5. Some Bounds for General Graphs 

In this section we provide a lower bound on dcti(G) and an upper bound on cti(G); both 
bounds hold for any G. These results have independent interest and will also be used in Section [6] 
to obtain dcti(G) and ct%(G) for special graph families. As already stated, we assume that K, 
the number of cops, equals c(G). 

5.1. General lower bound of dcti(G). Let G = (V, E) be any graph and (Xt)ten any search- 
ing schedule for K E N cops (the fcth cop, k E [K], moves from X^_ x to X\ at time t E N). For 
t E N , let Z t = {Jke\K]{Xt} De the set of vertices occupied by the cops at the end of turn t. 

We now define certain conditional probabilities which will be used to obtain the lower bound 
on dcti(G). 

pt(v) : Pr("at t-th turn, after the cop move, robber is at v" | "robber has not been captured"), 

Pt(v) : Pr("at t-th turn, after the robber move, robber is at v" | "before a possible capture"), 

Pt{v) : Pr("at the completion of t-th turn, robber is at v" | "robber has not been captured"). 

The following remarks should make clearer the meaning of the above probabilities. Effectively, 
we break each turn of the game into three phases. 

(1) In the first phase, the cops move and they may capture the robber or not. The probability 
that the robber is at v, given that he has not been captured, is pt(v). 

(2) In the second phase, the robber moves but a possible capture (i.e., if he entered a vertex 
occupied by a cop) is not yet effected. Hence pt(v) is the probability that the robber is 
at v (even if v contains a cop). 

(3) In the final phase possible captures (i.e., if the robber ran into a cop) are effected and 
Pt{v) is the probability that the robber is in v given that no capture took place. 

So finally, the probability that the robber is caught at time t G N is 

Ct = (pt-i{ u )+Pt{v)y 

uez t 

We will now write the equations which govern the evolution of pt{v), Pt(v), Pt{v). It is easy 
to see that, for every v G V, po{v) = (the robber has not entered the graph yet). Note that 
po is not a probability distribution; one can think of it as a useful function to get the desired 
recursion started. It is easy to see that ptiy) = 1/n. Regarding po(v) we have po(v) = for 
v G Zq, and 

p (v) 1/n 1 

1 -2^uez PoW l-\Z \/n n-\Z \ 

for v G V \ Z . 

Suppose now that, at a given time t EN, the game is still on; that is, the robber is still hiding 
somewhere on the graph G. Suppose that we know the distribution of the position of the drunk 
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robber, p t _i : V — > [0,1], at the end of the previous turn (let us repeat that this probability 
is conditional on the robber not having been captured). The cops move from X t _i to X t , and 
so they capture the robber with probability Yluez Vt-iiu). Conditioning on the fact that the 
robber is still not captured, let p t {v ) be the probability that the robber is at vertex v after this 
cop move. We have p t {y ) = for v G Z t , and 

Pt{V) = Z ^ 7-T (17) 

for v G V \ Z t . 

Now, the robber performs a step of his random walk. Let pt(v) be the probability that he is 
at vertex v after this move; that is, 



PtW 



The probability of the robber being captured at the completion of his move is J2 ueZt Pt( u )- 
Assuming, as before, that the robber is still lucky at the end of turn t, we get the formula for 
the distribution of the robber's position at the end of turn t (once again, conditioned on the 
robber not having been captured). For v G Z t : pt{v) = 0; for v G V \ Z t : 

MV) = - ^Kj-y (19) 



Eqs.(17)-(19) along with the initial conditions for t = 0, describe the evolution of pt(v), pt(v), 
Ptiy) for a given strategy of the cops. Now, we are ready to state a lower bound for dcti{G) for 
a general graph G. 

Lemma 5.1. Let G be any graph on n > c(G) vertices with maximum degree A = A(G) and 
minimum degree 5 = 6(G) such that j^tk) — 1/24. Then, 

^ >- 

Proof. We will use the notation introduced earlier in this subsection. Let G = (V, E) be any 
graph, and suppose that K = c(G) cops try to catch the drunk robber on this graph. We 
can assume that n > K\ the statement is trivially true otherwise. Let us define the following 
deterministic function: Mn = -^4, and for t G N 

u n—K ' 

M, M '~' 



1 - 2KM t _ 1 

We will show that for any t G No and any vertex v G V we have 

m^\p t {v)Mv),Pt{v)] < M t ^^-. (20) 

We prove the claim by induction. Since for each v G V we have 

T/n~/n , ^^ 1 , , 8 , , deg(f ) 
max\p (v),p (v) :Po (v) < = M Q - < M - 



n-K A _ A 
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the base case (t = 0) holds. Suppose now that (20) holds for t — 1 G N . It follows immediately 
from (17) that for any v G V 

1 - £ uG z t Pt-x{u) 1 - KM t -i A 



From (18) we get that 



Pt{v) 



ueN(v) deg ^ ~ ueN(v) de §( M )( 1 - KM t-i) 



for any f G V, so the very same bound holds for pt(v). Finally, from (19) we get that 



l-E„EZ,ftW " l-JfM,.! V 1 — KM t -\ ) 1-2ATM,_ 1 A 
and the proof of the claim is complete. 

<5(n-if) (whicxx m,,,,,., ,.«,., ....... ■ , M( ,_ /v) 



Suppose that M t _i < 77 (which implies that M s < for < s < t, since M s is 



increasing with s). Then, 



6AK V 1 . / 6AK V* A / 7AKt 



M ^ M ^\ l -W^K)) ^-^^-S^K)) -W^K) eXP \S.(n-K)J' 
where the last inequality follows since t^— < e 7x/6 for x < 1/4 and < 1/24. Therefore, it 

takes at least r = S ^ak ' > s ^ e P s 101 to reach S f^ K \ ■ During this time period, the probability 
that we catch the robber at a given time t < r is 

6KA 



S(n - K) 



Hence, the probability that the robber is still not caught at time r is at least 

QKA » . 

> e" 1 . 



5(n-iT) 

Finally, we get that the expected capture time is at least r/e, and the proof is finished. □ 

5.2. General upper bound of ctj(G). In this subsection, we investigate the adversarial robber 
case providing a universal upper bound for the capture time. 

Lemma 5.2. Let G be any graph of n vertices with maximum degree A = A(G), cop number 
c(G), and diameter D = D(G). Let T denote the maximum number of steps it takes for c(G) 
cops to catch the visible robber, when they use an optimal strategy (independently of the position 
of the robber). Then, 

cti(G) < (f + D) ■ (A + lf -n. (21) 
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Proof. We will introduce a cop strategy by which the adversarial robber will be captured in at 
most (T + D) ■ (A + 1) T • n time steps (even if he knows the strategy in advance and plays 
optimally against it). 

The cop strategy is executed in rounds, each round consisting of one or more steps of the 
game. In each round the cops first move to those vertices from which they can capture the 
visible robber (independently of his position) in at most T steps. (Such a T < oo exists for 
every G, since c(G) cops suffice to capture the visible robber in finite time.) Note that in the 
first round the cops start immediately from the aforementioned vertices. At any rate, once the 
cops are there, they uniformly at random guess the current position of the robber, and then at 
each of the next T steps they uniformly at random guess the behaviour of the robber and apply 
their optimal move for this guessed behaviour. The round is over T steps after the cops arrived 
at their optimal starting position. If the robber has not been captured by then, the cops start 
the next round, following the same strategy. 

In each round, it takes at most D steps for the cops to go back to the optimal starting position; 
after that they move T additional steps in which the robber might be caught. In order to catch 
the robber during one round, it suffices that the cops guess correctly the position of the robber 
at the start of the round (which happens with probability -) and also guess correctly the move 
of the robber in each of the following T steps. Since the robber at each vertex has at most A + 1 
choices (he can move to any of the at most A neighbours, or he can stand still), in each step the 
probability of the cops making the right choice is Thus, capture in a round happens with 
probability at least n (A+i)f • Since the bounds on the number of a round hold independently 
of the starting point, consecutive rounds are independent, and the expected number of rounds 
until the robber is caught is at most n • (A + 1) T . Hence, ct, L < (T + D) ■ (A + 1) T • n and the 
proof is complete. □ 



Remark. The bound of (21) does not mean that cti(G) is 0(n). Both A and T depend on G 



and hence on n, the number of vertices. 

6. The Cost of Drunkenness for Special Graph Families 

We will now show that, by restricting ourselves to some particular graph families, we can 
obtain non-trivial bounds on the iCOD. Paths and cycles were considered in |26j . so we state 



the results only (Subsection 6.1). The complete d-ary tree of depth L is studied next (Subsec- 
tion 6.2), and then we study the grid (Subsection 6.3). Finally, in Subsection 6.4, we give an 
example of a family of graphs (brooms) showing that Fi(G) can be arbitrarily close to any value 
in [2, oo). 

6.1. Paths and Cycles. The following two theorems have been proved in 
Theorem 6.1. Let P n be the path of n vertices. Then cti (P n ) = n — 1 and 

n ( ^ ( 1°K n \ \ , , i n — 1 

' ' O — < dcti(Pn) < — — . 



2 V \ n 

In particular, dcti = (1 + o(l)) • | and the cost of drunkenness is 
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Theorem 6.2. Let C n be the cycle of n vertices. Then ct{ (C n ) = z ^ and 

n ( „ / log n \ \ , , ^ . n — 1 

- A { l -°{-jr))^ dct ^)^—- 

In particular, dcti{C n ) = (1 + o(l))j and the cost of drunkenness is 

6.2. Trees. We restrict ourselves to T^l, the complete d-axy tree of depth L, for d > 2. This 
tree has n = ^rrr^ vertices and M = d L leaves. We know that one cop suffices to capture 
the robber on any tree, so let us consider a game played by a single cop and a robber. In this 
subsection, we will show the following results. 

Theorem 6.3. Let G = T^l be the complete d-ary tree of depth L with n = vertices. 
Then, 

In particular, cti(G) = 0(nlogn) 



2Ld L ~ l ■ (1 - oil)) 3 — - < cU(G) < 2Ld L - 1 • (1 - o(l)). 



Theorem 6.4. Let G = T^ l be the complete d-ary tree of depth L with n = 1 vertices. 
Then, 

dcU(G) = 9(n). 



The following corollary is an immediate implication of these two theorems. 



Corollary 6.5. Let G = T^l be the complete d-ary tree of depth L with n = 1 vertices. 
The cost of drunkenness of G is 



Proof of Theorem (L3. Since c(G) = 1, the (invisible) robber is chased by a single cop. To 
simplify the notation we use X t = X\ for a position of the cop at time t (this time the vector 
X t has one coordinate). 

In order to give an upper bound on ctj(G), we provide a strategy for the cop and show that, 
independently of the robber's behaviour, in expectation, the cop will catch the robber after 
at most a certain number of steps. Denote by a preleaf a vertex at distance 1 from any leaf. 
Consider the following strategy of the cop: 

(1) Start at the root, 

(2) Choose uniformly at random a preleaf v and go there, 

(3) Choose a random permutation of the leaves below v and visit them in this order, always 
returning to the preleaf v , 

(4) Return to the root, 

(5) Repeat from step 2 down. 

Similarly to Lemma 5.2 a round is a sequence of steps starting at the root, visiting a preleaf and 
all its leaves and going back to the root. Note that each round consists of 2L + 2{d — 1) steps. 
Observe that the cop's strategy in step (2) is equivalent to choosing at each layer 0<KL-2a 
random vertex among all neighbours at layer i + 1 with probability -j. Note that, independently 
of the robber's strategy, he is caught in each round with probability ^r=r. Indeed, provided that 
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the robber is in the subtree below the cop (at some step < % < L — 2), the probability that 
this is also true at the next round is 1/d. If this property is preserved from the beginning of 
the round until step L — 2, the robber has no chance to survive and is caught after visiting all 
leaves. 

Since all rounds are independent, the expected number of rounds needed to capture the robber 
using this strategy is d L ~ x , and thus 

cti < d L - 1 (2L + 2(d - 1)) - L - (d - 1), (22) 

since in the last round the cop does not have to return to the root (and so he saves L moves), 
and he has to visit only half of the leaves (in expectation) before catching the robber (and so 
he saves another 2(d — 1) — 2| = d — 1 moves, in expectation). 

For the lower bound, we provide a strategy for the robber against which any cop will need 
at least a certain number of rounds, in expectation. The robber strategy depends on the cop's 
moves and can be briefly described as follows: the robber always tries to be (after his move) 
at distance 2 from the cop. As a result, the distance between players is never larger than 3. 
Moreover, the robber is trying to stay at the layer above the cop, if it is possible. Let us now 
describe the robber strategy in more detail. 

(1) For t = 0. After the cop decides to start at X , the robber selects a vertex Y at distance 
2 from the cop. 

(a) If Xo is located at layer i > 2, then Yq is the unique vertex at the layer i — 2. 

(b) If Xo is at the first layer, then the robber chooses (uniformly at random) a vertex 
that is also at the first layer but is different from X . 

(c) Finally, if X is the root of T d:L , then the robber chooses (uniformly at random) any 
vertex at the second layer. 

(2) For t > 1. The cop moves from X t _i to X t , the robber is at Y t _i, and is about to move. 
There are a number of possibilities to deal with. 

(a) dist(X t ,Y t _i) = 0: the game ends. 

(b) dist(X t , Y t _i) = 1 and no neighbour of Y t _ x is at distance 2 from X t (the robber is 
at a leaf): the robber stays at the same vertex; that is, Y t = Y t -\. 

(c) dist(X t , Y t -\) = 1 and there is a neighbour of Y t ^\ at distance 2 from X t : the robber 
chooses (uniformly at random) a vertex at distance 2 from X t that is as close to the 
root as possible. 

(d) dist(X t , Y t -\) = 2: the robber does nothing; that is, Y t = Y t -\. 

(e) dist(X t , Y t _i) = 3: there is a unique neighbour of Y t _\ at distance 2 from X t ; the 
robber goes there. 

It is easy to check that, under this strategy, the distance between the cop and the robber never 
becomes greater than 3. 

Assume that the robber uses the randomized strategy described above; we will show that, 
even if the cop is aware of this, the capture time will be Q(nlogn) and so ctj(G) will be of at 
least the same order. Observe that the the robber will only be caught in a leaf. Moreover, any 
optimal cop strategy must start either at the root or at a neighbour of the root, as otherwise 
the robber chooses a vertex above the cop and the cop is forced to move towards the root. If 
the cop starts at the root, then he catches the robber on a leaf if, when in layers < i < L — 2, 
he chooses always the subtree of the robber. The advantage of starting at a neighbour of the 
root is this: since the cop knows the strategy used by the robber, he infers that the robber is in 
one of the d— 1 other subtrees (not d, as before). This is a much bigger advantage comparing to 
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the additional step back to the root. Hence, this strategy is slightly better and we will consider 
only this one. (Of course, this applies to the first round of moves only, so starting from the root 
has exactly the same asymptotic expected capture time.) Note that the probability of choosing 
the right subtree after going back to the root is -pj • (^) i_2 , since at consecutive layers there is 
no possibility to obtain partial information about the position of the robber except by checking 
leaves. The cop does not necessarily have to check all leaves (although this is clearly the best 
strategy), and thus in order to get a lower bound we will not count the time it takes to check 
these leaves (we count only the time it takes him to check one leaf). Also, after having exploited 
all leaves of a preleaf (we can assume the cop did this, since we do not count these extra steps), 
the cop has to turn back to the root to continue exploiting other subtrees, as otherwise the 
robber will never be caught. 

By the same argument, avoiding the subtree the cop comes from, the probability that in the 
next sequence of steps from the root to a leaf the cop catches the robber is again ;py(^) L ~ 2 - 
Since one way to one leaf and back takes at least 2L steps, the expected capture time for any 
cop strategy is at least 

cti(G) > 2L ■ (d - 1) • d L ~ 2 - L, (23) 



since in the last round the cop does not have to get back to the root. Thus, combining (22) 
and (|23)), we see that cU(G) = Q(Ld L ) = e(nlogn). □ 



Proof of Theorem 6.4 We consider the drunken robber performing a random walk on G = T^l, 



starting from a vertex chosen uniformly at random. The lower bound follows from Lemma 5.1 
since A(G) = d + 1, 5(G) = 1, and c(G) = 1. We have 

T) — 1 

dcbi(G) > 7e _ {d+1) = 0(n). (24) 

For an upper bound on dcti(G), we analyze the expected capture time of a cop standing still at 
the root vertex. Denote by ej the expected capture time if the robber starts at level j (the root 
is considered to be at level 0). By definition, eo = 0, = 1 + ei-i and 

e > = 1 + dh^- 1 + dTi e > +i 

for 1 < j < L — 1. Since e L -i = 1 + ^(1 + e L _i) + j^e L - 2 , we have e L _i = 2d + 1 + e L -2- 
Similarly, e^_2 = 2d 2 + 2d + 1 + e£_ 3 , and in general 

L-j 

k=0 



for 1 < j < L — 1. Thus, 

ei = 2^V-1, 



L-l 



k=0 

L-2 L-l 

e 2 = 2j2d k -l + 2j2d k - 1, 

k=0 k=0 

L-l r L-l ,, r+1 _ 

eM = 2 ££<i*-(L-i) = 2£!L- :T I-L + i 

r=l k=0 r=l 
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and, 



£4 d r+l - 1 T 2 A Jr 2L - 2 T 

e L = 2 > — L + 2 = > d r , L + 2 

^ d- 1 d- 1 ^ d-l 



2d L+1 -2 2 + 2d 2L-2 
(d-l) 2 ~ d-l ~ d-l ~ 1 
2d L+1 -2 2d + 2L 

-L + 2. 



(d-l) 2 d-l 
Since > ej_x for all 1 < i < L, 

dcU(G) <e L = 0(n). (25) 
Combining (24) with (25), we obtain dcti(G) = O(n), and the proof is complete. □ 



6.3. Grids. In this subsection, we investigate the square grid P^DP N . The result can be easily 
generalized to rectangle grids. The adversarial robber case seems to be non-trivial. Our upper 



bound follows from the general upper bound provided in Lemma |5.2| We have no good lower 
bound so determining the order of c£j(PjvO-Piv) f° r a grid remains an open problem. We do 
much better in the drunk robber case showing that dcii(P/vn-P/v) is linear. 

Theorem 6.6. Let PjvDP/v be the square N x N-grid with n = N 2 vertices. Then 

cU(P N UP N ) = 0(n 3/2 5 VE ). 



Proof. Since D = 2N, T = N — 1, A = 4, it follows from Lemma 5J2 that 

cti(P N nP N ) < (3N - l)nh N ~ l = 0(n 3 / 2 5^), 
and the result holds. □ 
Theorem 6.7. Let PnOPn be the square N x N-grid with n = N 2 vertices. Then 

dcti(P N UP N ) = 0(n). 



Proof. Since c(PnUPn) = 2, A = 4, and 5 = 2, it follows from Lemma 5.1 that dcti(G) > ^ = 
Q(n) and thus the lower bound follows. 

On the other hand, for the upper bound, consider the strategy of two cops standing still at 
antipodal corners of the grid. Assume, without loss of generality, that the first cop is at the 
top right corner of the grid, and the second one at the bottom left corner. For i G {1,2}, 
denote by di(t) = dist(Xl,Y t ) the distance of the i-th cop from the robber at time t. Set 
di(t) = 0, if the robber was caught by time t by cop i. Note that di(t) < 2N for any t. Since 
the robber is performing a random walk, on any interior point of the grid and also on the two 
antipodal corners not occupied by the cops, with probability \ the value of di(t) increases by 
1 and ds-i(t) simultaneously decreases by 1 (for both i e {1,2}). On the remaining points of 
the border, the probability that di(t) increases by 1 and simultanouesly d 3 _i decreases by 1 is 
| if di(t) < d 3 _i(t), and it is | otherwise, for both % 6 {1,2}. Thus, the robber's movements 
can be seen as moves on the truncated integer line {0,2iV}, corresponding to the distance of 
(say) the first cop, and the first time the robber hits any of the two endpoints, he is caught 
by one cop. Our goal is now to couple the standard random walk (the walk starting at any 
integer position, and going with probability \ to the right and with probability \ to the left) on 
this truncated integer line with the robber's movements, taking into account the special border 
conditions of the grid. Let (Z t ) be a sequence of independent random variables, where for each t, 
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Pr(Z t = 1) = Pr(Z t = — 1) = |. Let (B t ) be another sequence of random variables coupled with 
Z t , taking into account the different transition possibilities on the border: provided that the 
robber is not yet caught by time t, set B t = if Y t _\ is either in the inside of the grid or one of 
the two corner points not occupied by the cops, and otherwise set B t = (di(t) — d\{t — 1) — Z t ). 
Interpreting a positive value of Z t as a step of the robber going down or going left and a negative 
value as a step going up or going right at time t, and recalling that d\ increases if and only if d 2 
decreases, we have 

d 1 (t) = rfi(o) + E*=i^i + E*=i^ 
d 2 (t) = rf 2 (o)-E- =1 ^-E*=i^ 

provided that the game is still on. Since Ej=i Bj * s the same f° r both values, at any time t 
either 

t t 
di(t) < di(0) + J2 Z i < 2N + J2 Z i 

3=1 3=1 

or 

t t 
d 2 (t) < d 2 (0) -J^Zj <2N -J2%3 

3=1 3=1 

holds. Set now t = cn for some constant c > 0. Since \di(t) — di(t — 1)| < 1 for any i e {1, 2} 
and any t, the robber is caught by the first cop by time cn, if Ej=i %j — — 2A^, whereas in 
the second case he is caught by the second cop if Ej=i %j — ^N. Since Pr(Ej=i Zj > 2A^) = 
Pr(Ej=i Zj < —2N), in both cases the robber is caught with probability at least the one that 
the simple random walk on the integers at time cn is at a position bigger or equal to 2N (recall 
that the simple random walk is the standard random walk starting at the origin). Denote by 
qk{r) the probability that the simple random walk on the integers, starting at position k 6 N 
has at least once reached the position by time r. By Theorem 2.17 of [30] 



qh{r) > 1 - 




Applying the theorem with k = 2N = 2^/n(l + o(l)) and r = cn we see that with probability 
at least (1 + o(l))(l — ^|) the simple random walk starting at 2N passes the origin by time 
cn. In other words, with at least this probability, there exists some time r < 2N such that 
Ej=i Zj — 2N. Conditioning under this event, by symmetry we get that with probability at 
least |, the value of Ej=i %j > 2N. Thus, with probability at least 

di(cn) = for some i G {1, 2}. This holds independently of the starting position of the robber, 
and thus, if the robber is not yet caught by time cn, the same lower bound holds for the 
probability of being caught in the next round of cn steps. Hence, the expected number of 
rounds until the robber is caught is at most -7, and thus dcti(PNDP N ) < ^cn = 0{n). □ 

6.4. Brooms. In this section we consider a family of graphs which we call brooms. The broom 
graph B(c,n), with n vertices and a parameter c (0 < c < 1) is illustrated in Fig. [2j It consists 
of a path with cn vertices, joined at one endpoint (the center of the broom) with a star of 
(1 — c)n vertices. The end of the broom is the other endpoint of the path. 
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Figure 2. The broom graph B(c,n). 
Bounding cti(B(c,n)) and dcti(B(c,n)) is interesting as an illustration of the game-theoretic 



approach. Perhaps more importantly, Corollary 6.10 shows that, for large n and appropriately 
selected c, Fi(B(c,n)) can be arbitrarily close to any value in [2, oo). Note that Corollary 6.10 
holds for every (sufficiently large) n, i.e., it is a property of the entire broom family. 

Theorem 6.8. dcti(B(c,n)) = (1 + o(l))^. 

Theorem 6.9. cU(B(c,n)) = (1 + o(l))n. 

Corollary 6.10. For any < c < 1, 

cU(B(c,n)) 



Fi(B(c,n)) 



;i +o(i))- 



dcti(B(c, n)) 

Hence, for every a G [2, oo) there exists c G (0, 1] such that Fi(B(c,n)) = (1 + o(l))a. 

Proof of Theorem 6.8\ One possible strategy for the cop is the following: start at the center of 
the broom, wait there for one step, and then go to the end of the broom. Since the robber's 
position is distributed uniformly at random, and the robber has to move in every step, we have 
the following cases. 

(1) With probability 1 — c the robber starts on a leaf of the star and is caught in 0(1) steps. 

(2) With probability c the robber starts on any vertex of the path and (starting at t > 2) 
the cop starts moving towards the end. In this case the problem is reduced to catching a 
drunk robber on a path of cn vertices and this, by Theorem 6.1, takes (1 + o(l))y steps 
in expectation 

Hence 

cn 

dcU(B(c, n)) < (1 - c) ■ 0(1) + c ■ (1 + o(l))— = (1 + o(l))- ^ 

On the other hand, this is clearly the best strategy: with probability c the robber is on one 
of the vertices of the path and, since the vertices of the star do not help, in this case, again 
by Theorem 6.1, the expected time to be caught is (1 + o(l))cn/2. Hence, dcti(B(c,n)) = 
(l + o(l))^. □ 

Proof of Theorem 6.9 For an upper bound we assign the following strategy for the cop. He 
starts at the end of the broom, moves to the center and, once there, he cheks all leaves in 
random order without repetitions. The robber's best response is to start at a randomly selected 
leaf and stay there until caught (actually he could move into a different leaf or even outside of 
the star as long as the cop is "sufficiently distant", but this will not change expected capture 
time). The expected capture time under these strategies is the sum of two terms: 



2 

c n 
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(1) the cop needs cn steps to go from the end to the center; 

(2) once there, the cop will on the average need to check (1 — c) n/2 leaves before he captures 
the robber and every such check requires two steps (one from the center to the leaf and 
one back), except the very last move which requires only one step. 

Hence 

cU (B (c, n)) < cn + 2 (1 - c) n/2 = n. 

A lower bound for cti(B(c,n)) can be established by describing a robber strategy and proving 
that it is optimal. Before we describe such a strategy we need some additional notation. Let us 
assign the "coordinate" to the end of the broom and the "coordinate" cn to the center. The 
cop's initial position X can then be written as bn, where b G [0, c] (actually this excludes the 
possibility that X Q is a leaf but, as we will soon see, we need not concern ourselves with this 
case). Note that b is a parameter of the cop's strategy; also, the robber will observe b before he 
makes his first move. 

Before the game starts, the robber announces that he will use the following strategy: he will 
go to the end of the broom with probability q = q(b) = b, and to a randomly chosen leaf with 
probability 1 — q. The cop is aware of this and his only reasonable responses (after having 
started at bn) are the following. 

(1) With probability p, the cop can go towards the end of the broom, and then back to the 
center to sweep all leaves. 

(2) With probability 1 — p he can go to the center, sweep a randomly chosen x-fraction of 
the leaves (for some x G [0, 1]), then move to the end of the broom, then go back to the 
center, sweeping all leaves (of course, for x — 1, he will have captured the robber by the 
time he reaches the end, at the latest; so he will not need to revisit the center). 

We do not consider the possibility that the cop starts at a leaf because this does not influence 
the asymptotic behavior of the expected capture time; this justifies our previous claim that the 
cop's initial position can be parametrized by bn. 

It is easily seen that the above family of strategies (parametrized by (b,p,x)) guarantees 
capture (of course capture may take place before the full schedule is executed). Note that if c is 
exactly 1, we have a path, and cU(B(c,n)) = (l + o(l))n. Also, if b is exactly 0, the cop starts at 
the end of the broom, and the robber's only reasonable strategy is to hide at a randomly chosen 
leaf. In this case, the expected capture time is also (1 + o(l))n. Excluding these cases from the 
following analysis, we can break down the expected capture time into the following cases. 



R starts at 


C moves towards 


Prob. 


Distance Travelled 


end 


end 


bp 


bn 


a leaf 


end 


(l-b)p 


(b + c+(l-c))n 


end 


center 


6(1 -p) 


((c - b) + 2x(l - c) + c)n 


a leaf 


center 


(l-b)(l-p)x 


((c-b) +x(l - c))n 


a leaf 


center 


(l-6)(l-p)(l-x) 


((c - b) + (2x(l - c) + 2c + (1 - c)))) n 



TABLE 1. The possible ways in which the robber can be captured. 



The case in which the robber hides in the leaves and the cop starts by moving towards the 
center is broken down to two subcases (and hence requires two rows in the above table). 
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(1) In the first subcase, the cop checks an x-fraction of the leaves and captures the robber, 
before visiting the end of the broom. This happens with probability x and the average 
number of leaves checked is x ■ (1 — c) • n/2. 

(2) In the second subcase, the cop checks x-fraction of the leaves, fails to capture the robber, 
visits the end of the broom and then returns to check all the leaves (and so capture the 
robber with certainty). This happens with probability 1 — x and the number of leaves 
checked is x ■ (1 — c) • n during the first visit and (1 — c) • n/2 (on the average) during 
the second visit. 

The expected capture time for a given value of c is E{T) = (1 + o(l))f c (p, b, x) ■ n and 
f c (p, b,x) ■ n is obtained by multiplying the entries of the last two columns of Table [TJ adding 
and performing some algebra. We finally get 

f c (b,p,x) = (—l + b + c + p — bc — bp — cp + bcp) x 2 + 

(1 + b — 3c — p + be — bp + Sep — bcp) x + (2c — 26 + 2bp — 2cp + 1) . 

Hence f c (b,p,x) is a quadratic function in x, and (after some factorizations) can be rewritten 
as follows: f c (b,p, x) = a 2 x 2 + a x x + a , with 

a 2 = _(l-p)(l-6)(l- c ) 
a x = (1 -p)(l - 3c + bc + b) 
a = 2(1 -p)(c- b) + 1. 

Since a 2 is negative (unless p — 1, where the whole function is zero), the parabola is downward 
concave, and thus it achieves its minimum either at x = or at x = 1. If x = 0, f c (b,p,x) = 
do = 1 + 2(1 — p)(c — b) > 1. If x = 1, f c (b,p,x) — 02 + ai + do — 1, and thus the minimum 
is achieved there. Thus, cU(B(c,n)) > (1 — o(l))n; this, together with the upper bound, shows 
that the robber strategy is optimal and that cti(B(c,n)) = (1 + o{l))n. □ 

Remark. The broom B(c,n) is a combination of the path P n and the star S^: high c values 
make B(c,n) more like a path and low values more like a star. Accordingly, high c values 
bring Fi(B(c, n)) closer to Fi(P n ) = 2 and low values increase Fi(B(c,n)) unboundedly, which 
is similar to the behavior of F^Sn) for large N. 

7. The "Infinite Speed" Robber 

In this section we change the rules of the game slightly. Suppose the robber is still invisible 
but now is endowed with "infinite speed" . In this case, what is iCOD? 

We use the term "infinite speed" for brevity. What we actually assume is that the robber has 
speed s 6 N, i.e., during his turn he can traverse at most s edges (as long as he does not go 
through a vertex containing a cop) and we examine what happens in the limit when s tends to 
infinity. Let us note that the adversarial robber can choose to traverse fewer edges or even stay 
in place. As for the drunk robber, he simply performs s steps of a random walk on G; if during 
one of these steps he runs into a cop, he is captured. Finally, the cops will still have unit speed. 

We will use the notation ctj (G, s) to denote the expected capture time given that the robber 
is invisible, adversarial and has speed s; dcti (G, s) and Fj (G, s) are defined similarly. Obviously 
we have ctj (G, 1) = ctj (G), dcti (G, 1) = dcti (G), Fi (G, 1) = Fj (G). We are interested in the 
limits 

lim cti (G, s) , lim dcti (G, s) , lim Fi (G, s) . 
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In the case of drunk robber, it is actually quite easy to find lim^oo dcti (G, s). Suppose C 
has c{G) cops, and he keeps them stationary at some vertices Ui,u 2 , ■ ■ ■ , umq)- As s becomes 
large, the robber essentially performs a random walk on G with Ui (i G [c(G)]) being absorbing 
vertices. Since a random walker visits every vertex of G in finite expected time, the probability 
that the robber will hit an absorbing state during the first turn (conditional on not starting at 
absorbing state) approaches 1 as s — > oo. Hence lim^oo dcti (G, s) = "~^ G - > . 

Next let us note that, for the adversarial robber, s does not need to increase all the way to 
infinity. With s — \V\ — n, the robber can in one turn reach any vertex in G. In other words 
lim^oo cti (G, s) = cti (G, n). In short, 

,. c, (rl x lim s ^oo cti (G, s) cti(G,n) n 

^ (G ' S) = M^dct^Cs) = = ti^cJG) (G ' n) ■ 

Hence we now must study cti(G,n). Let us first establish that cti(G,n) exists. The game 
theoretic analysis of Section [4] holds for any value of s; a feasible robber strategy now specifies 
(probabilities on) moves which traverse at most s edges without crossing a cop-occupied vertex. 
Hence cti (G, n) is well defined. 

It is easy to see that lim^oo Fi (G, s) can take any value in N. For example, for the path P n we 
see immediately that lim^oo Fi (P n , s) = lim^oo -^jctj (P n , s) = n. As an additional example, 
let us consider lim^oo Fi (Sn, s) on the star Sn- When CiR is played on Sn, the adversarial 
infinite-speed robber can move to any leaf in his turn; hence he has more options than the 
unit-speed robber, who must remain in his original vertex for the entire game. However, let C 
control a single cop, who starts at vertex 0, searches a randomly selected leaf (with repetitions) 
at odd times and returns to at even times. It is easy to see that this strategy is optimal and 
its expected capture time (i.e., cti (G, s)) is (for any s > 2): 

OO /AT 1 \ t— 1 -, 

ctdG,s)=(j2[ — ) jy(2f-l))-l = 2JV-l. 

t=i ^ ' 

(One time step is subtracted because after capture the cop does not need to return to vertex 0.) 
For the drunk robber we will have (for all s): dcti (G, s) = j^tj- Hence 

MF,( i »,,) = (M -" v (y+ " =e(4 

The example of the infinite speed robber on Sn illustrates an additional interesting point. 
Recall the graph search (GS) game [42J. Similarly to CiR, GS involves a team of searchers (cops) 
and a fugitive (robber) who is invisible, adversarial and infinitely fast |19j . GS and CiR differ 
in one respect: in GS the fugitive is assumed to reside in the edges, not the vertices of G. But 
there are GS versions of node search and mixed search. Furthermore, in "classical" GS the cops 
are not restricted to move along edges; but there is a variant of GS, called internal search, in 
which this restriction is imposed. Let us simply state, without giving details, that the capture 
mechanism of CiR is equivalent to that of internal mixed GS (the interested reader can check 
this fact using [Tj5] and the references therein). 

We denote by c°° (G) the minimum number of cops required to capture the invisible, adver- 
sarial and infinitely fast robber on G; we denote by s (G) the minimum number of searchers 
required to guarantee capture of the fugitive in G, using internal mixed search. One would 
assume that these two games are equivalent and that s (G) = cf (G). However this is not the 
case: in the Sn example we have cf 3 {Sn) = 1 < 2 = s (Sn)- Hence, at least for some graphs, 
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we can have c°° (G) < s (G). The reason for this is that in GS the fugitive is assumed to know 
in advance the entire itinerary of the searchers (i.e., he is omniscient), while in CiR the robber 
only knows the past cop moves (and it suffices that the cops have a strategy that guarantees 
capture in finite time with probability one, not to have a strategy that catches the robber in 
finite number of steps.) 

8. Conclusion 

We have examined CiR, the invisible-robber version of the CR game. Our main interest was 
in the cost of drunkenness Fi (G) which, as we have shown, exists for every graph G and can 
get arbitrarily close to any value in [2, oo). To establish these results we have used concepts 
from game theory and the theory of partially observable Markov decision processes. For several 
families of graphs including stars, d-regular trees and grids we found (almost) exact bounds, and 
moreover we gave general upper and lower bounds. Finally, we have briefly examined the CiR 
variant in which the robber is infinitely fast and we have found, somewhat surprisingly, that the 
corresponding cop number q (G) can be smaller than the (internal mixed) search number s (G). 

Our work can be extended in several ways. We first state some open problems. 

(1) For a general graph G prove: |l^(L?)| > 2 =>- Fi(G) > 2. We conjecture (but have not 
been able to prove) that this is true, because we have not found any graph G with both 
\V{G)\ > 2 and F^G) < 2. 

(2) For the square grid, find an asymptotically exact value of ctj(P/vDP/v). We have obtained 
a subexponential upper bound on cti(P N DP N ) but we have not been able to find a 
nontrivial lower bound. By "nontrivial" we mean a tight bound; e.g., if a superpolynomial 
lower bound is found we will be very close to obtaining an asymptotically exact value 
for cti(P N nP N ). 

(3) As mentioned, Fi (G) can get arbitrarily close to any value in [2, oo). On the other hand, 
there are values in [2, oo) which cannot be actually achieved by Fi(G) (for example Fi(G) 
cannot equal an irrational number). Prove that: for any a G [2, oo) R Q there exists a G 
such that a = Fi (G). 

(4) Find necessary and sufficient conditions for c{G) = cf (G). The equality holds for 
paths, stars and cliques; for what other types of graphs does it hold? 

(5) Find necessary and sufficient conditions for c°° (G) = s (G), where s(G) is the internal 
mixed search number of G. 

Finally, we list several future research directions. 

(1) We have obtained tight Fi{G) bounds for paths, cycles, trees and grids. Can similar 
bounds be obtained for additional graph families (e.g., planar, bipartite, series-parallel, 
chordal, high girth, geometric)? What about random graphs? 

(2) The use of algorithms becomes necessary for graphs which cannot be treated analytically. 
We want to develop tractable algorithms for the computation of cti (G), dcti (G),Fi (G) 
and also of optimal search strategies. It is well established in the literature that exact 
algorithms are computationally intractable; hence we intend to develop approximate 
algorithms, along with performance guarantees. 

(3) We have studied the cost of drunkenness under a game theoretic model of the adversarial 
robber. As mentioned in Section [TJ there is an alternative approach, in which the cops 
optimize their strategy under the assumption of an omniscient robber. We want to study 
the cost of drunkenness under this "worst-case" assumption. 
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(4) We have studied the cost of drunkenness, but our results can also be used to initiate a 
study (for both the adversarial and drunk variants) of the cost of invisibility. This can be 
expressed by the ratios ^iffi , ^iffi , the behavior of which we will study in the future. 

Acknowledgement: We thank D. Thilikos (several discussions with him led us to the study 
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